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We have investigated several classes of strong spin-orbit chalcogenides related to the (Pb,Sn)Te 
series studied in connection with the Dirac fermion physics in the 1980s. Our first-principle theoret- 
ical calculations suggest that ternary chalcogenides TlBiX2 and TlSbX2 (X=Te, Se, S) series harbor 
small bandgap topological insulators with single Dirac cone on some selective surfaces whereas the 
isostructural and isoelectronic silver-based AgBiX2 and AgSbX2 (X=Te, Se, S) series do not. We 
find that several Tl-compounds are in the vicinity of a topological critical point. We identify the 
precise surface termination that realizes the single Dirac cone. The single-Dirac-cone surface is 
shown to be correlated with a termination that minimizes dangling bonding effects favorable for 
ARPES experiments. Our results further suggest this class of topological semi-metals may harbor 
odd-parity topological superconductors similar to the possibility proposed for CuxBi2Se3 (Tc ^ 4K). 



Topological insulators are a recently discovered new 
phase of quantum matter [l|-[3|. The search for topolog- 
ical insulators in real materials has benefitted from the 
fruitful interplay between topological band theory and 
realistic band structure calculations [3-[T2j. As a result, 
a number of materials Bi^Sbi-^^, Bi2Se3 and Bi2Te3 have 
been experimentally realized as three-dimensional topo- 
logical insulators [il-lil, ITqI - [T2| . Recently the search for 
topological insulators has been extended to ternary com- 
pounds 0, [il. In this work, we report first-principles 
calculations of (Tl/Ag)-based III-V-VI2 ternary chalco- 
genide series, and compare their band structures with 
those of the related (Pb,Sn)Te series studied previously 
in connection to Dirac fermion physics [15j. We have 
also carried out slab calculations to study the nature 
of the surface states. We find a specific surface termi- 
nation which gives rise to simple Dirac-cone topological 
surface states due to the non-trivial band topology. We 
also propose several ways to engineer the band struc- 
ture of thallium-based chalcogenides towards achieving 
the single-Dirac-cone topological insulator phases. 

Designing new topological insulators involves modify- 
ing their structure or doping to shift band orders out of 
the natural atomic sequence. As an example, we consider 
the well-known case of (Pb,Sn)Te with rocksalt structure. 
The end phase PbTe, which possesses a face-centered cu- 
bic (FCC) lattice, is topologically trivial. Relative to 
PbTe, SnTe has band inversions at four equivalent L- 
points in such a way that the parity values of conduction 
and valence band are switched (see insets in Fig. IC). 
Since the inversion occurs at an even number of points 
in the Brillouin zone, SnTe is also a topologically trivial 
band insulator. Fu and Kane [5] proposed that a rhom- 
bohedral distortion along a particular 111 direction can 
bring (Pb,Sn)Te to a strong topological phase. This 
works since the band inversion occurs only at L-point 
along the 111 direction which is distinguished from the 



other three L-points (Fig. [Tp). 

The thallium-based III-V-VI2 ternary chalcogenides 
MM'X2 are or can be approxminately viewed as a rhom- 
bohedral structure with the space group i?3m[20| which 
possesses real-space inversion symmetry. The unit cell 
contains four atoms. The M = Tl, = Bi or Sb, and 
X = Te, Se, or S atoms occupy the Wyckoff 3a, 3b, and 
6c positions respectively. If M = M' and the correspond- 
ing hexagonal lattice constants a and c have the relation 
c = 2V^a, cubic symmetry is restored and the structure 
can be described as a rocksalt FCC lattice with a' = V2 a 
which contains only two atoms per unit cell. The rhom- 
bohedral lattice is embedded in a 2x2 supercell of the 
FCC lattice as shown in Fig. [TJA.. This relation between 
rhombohedral and FCC lattices is analogous to the type 
II antiferromagnet NiO, in which case M = Ni spin up, 
= Ni spin down, and X = O. The thallium-based 
III-V-VI2 ternary chalcogenides can also be considered 
as an offshoot of IV- VI semiconductors, and therefore 
referred to as pseudo IV- VI semiconductors [2ll - [2^ . Let 
us take TlBiTe2 as an example. Because the elements 
Tl and Bi precede and follow Pb in the periodic table, 
TlBiTe2 resembles PbTe where M = M' = Pb. In brief, 
by distorting the PbTe crystal along a 111 direction and 
replacing Pb atoms by Bi and Tl atoms alternating along 
that 111 direction, one obtains TlBiTe2 with rhombohe- 
dral structure. 

Since thallium-based III-V-VI2 ternary chalcogenides 
provide a rhombohedral version of (Pb,Sn)Te, one may 
expect that they also can display topologically non-trivial 
phases. To explore this issue, first-principles band calcu- 
lations were performed with the linear augmented-plane- 
wave (LAPW) method using the WIEN2K package [16j in 
the framework of density functional theory (DFT). The 
generalized gradient approximation (GGA) of Perdew, 
Burke, and Ernzerhof[17j was used to describe the 
exchange-correlation potential. Spin orbital coupling 
(SOC) was included as a second variational step using 
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FIG. 1: Topological band-structure of Tl(Sb/Bi)Te2 

: A. Crystal structure of an idealized TlSbTe2 with face- 
centered-cubic lattice. Tl, Sb, and Te are denoted by black, 
open, and gray circles, respectively. The Tl surface is em- 
phasized by black lines, the Sb surface by dotted lines, and 
the Te surface by gray lines. B. The Brillouin zone of a FCC 
lattice. The red line indicates the 111 direction for rhom- 
bohedral distortion. C-F the band structure of PbTe, PbTe 
calculated in rhombohedral structure with 4 atoms in one unit 
cell, PbSnTe2, and TlSbTe2. The FCC symbols for points in 
the Brillouin zone are used and defined in panel B for ease of 
comparison. The size of the red dots denotes the probability 
of s-orbital occupation on the M atoms. The inset highlights 
the band inversion which did not occur in panels C and D but 
does occur in panels E and F. 



scalar-relativistic eigenfunctions as a basis. The radius 
of the atomic spheres is 2.5 Bohr. The lattice constant 
were taken from the optimized lattice constants from ta- 
ble I of Ref. M 

To better illustrate the relation between (Pb,Sn)Te and 
thallium-based III-V-VI2 ternary chalcogenides, In Fig. 1 
we show band dispersions step-by-step for a sequence of 
structures which systematically evolve from FCC PbTe 
(Fig. WP) to TlSbTe2 (Fig. IF). For PbTe in the FCC 
lattice, the top of the valence bands is located at the 
L-points and a small gap is found. We then repeat the 
same calculation, but assuming a rhombohedral unit cell 
which contains 4 atoms or two chemical formula units, 
doubled along a particular 111 axis, to obtain the band 
structure in Fig. [Ip. As the unit cell is doubled in size, 
the bands are folded. In particular, the top of the valence 
bands at one L-point is folded to the F-point, and those 



at the other three L-points are folded to three equivalent 
X points. Note that at this stage the supercell is intro- 
duced as a purely formal device: since no distortions are 
introduced into the structure yet, the bands have exactly 
the same dispersion and do not interact with the shadow 
bands introduced by folding. In the next step (Fig. [Tfl), 
we replace one of the Pb atoms by Sn atom, resulting in 
alternating Pb and Sn planes along the selected 111 direc- 
tion. The dispersion of the original and folded bands now 
interact, leading to new band gaps and avoided crossings 
for the hypothetical ternary compound PbSnTe2. Other- 
wise, the band structure superficially looks quite similar 
to that found in Fig. [3). However, we now show that 
the conduction and valence bands have become inverted 
at high symmetry points after the Pb-to-Sn replacement. 
To monitor band inversion, we pay attention to the prob- 
ability of s-orbital occupation on the M atom (here M = 
Pb) at inversion center, whose magnitude is denoted by 
red dots. Since the s-orbital occupation must vanish for 
odd-parity band at high symmetry points, we use it as an 
indicator for band parity. Comparing the band sequence 
with red dots for PbTe and PbSnTe2, we find that band 
inversion indeed occurs at both the F-point and the X- 
points, most likely due to a weaker SOC and a smaller 
atomic size in Sn as compared to Pb. Because of an even 
number of band inversions, PbSnTe2 is also topologically 
trivial similar to SnTe. However, since PbSnTe2 only has 
rhombohedral instead of cubic symmetry, its band gaps 
at the F and X-points become unequal. The band gaps 
at X points were found to be smaller, which indicates 
band inversion from PbTe to PbSnTe2 occurs first at F 
and then at X. This raises the hope that by introducing 
a small rhombohedral lattice distortion or replacing Pb 
and Sn with other chemical elements, the second band 
inversion associated with the three X-points might be 
removed, leaving only a single band inversion relative to 
PbTe (in supercell) at the F-point which leads to a topo- 
logically non-trivial band structure. Based on the close 
relations between (Pb, Sn)Te and TlM'Te2, we therefore 
speculate that ternary compounds TlM'Te2 may have 
the desired band inversion described above. To test this 
idea, we use the optimized lattice constants from table 
I of Ref. (20, to generate the band structure of TlSbTe2 
shown in Fig [Tp. The overall band structure resembles 
that of (Pb,Sn)Te. The rhombohedral lattice distortion 
enhances all band gaps, especially at F, and shifts the 
band edges at the X-points. Our calculations shows that 
the bottom of the conduction band at the X-point over- 
laps the top of the valence band at a low symmetry point 
(not shown), leading to a semi- metal ground state with 
small electron pockets at the X-points. Nevertheless, 
since a direct band gap between the conduction and va- 
lence bands exists at every point in the Brillouin zone, the 
Z2 topology of valence bands are well defined. To study 
the band topology, one should focus on the band inversion 
relative to PbTe (in supercell) at the F-point and three 
X-points. As can be seen from the s-orbital occupation 
in Fig. IF, band inversion occurs at all four points, as in 
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FIG. 2: Band inversion and Parity analysis: Panels A 
and B show the bulk band structure of TlBiTe2 without and 
with bandgap corrections, respectively. FCC notation for the 
high- symmetry points of the Brillouin zone is used and defined 
in Fig. IB for ease of comparison. The band gap as a function 
of added orbital dependent potential Va is shown in C. The 
gray area highlights the features related to topological non- 
triviality. D and E show surface state dispersions in red lines. 
The projected bulk bands are shown as blue areas. 



PbSnTe2. So according to our DFT-GGA calculations, 
TlSbTe2 is a topologically trivial semi-metal. 

Figure 2(A) illustrates the band structure of another 
member of this family, TlBiTe2. It is seen to also be a 
topologically trivial semi-metal, as are all six thallium- 
based III-V-VI2 ternary chalcogenides presented here, ac- 
cording to DFT-GGA calculations. However, it is a well 
known problem of DFT that the band gap in semicon- 
ductors is underestimated. The simplest way to cor- 
rect the band gap is the scissor operation that shift 
rigidly the conduction band toward higher energy. Here, 
because band inversion necessarily involves orbital hy- 
bridization, such a rigid shift of the conduction band can- 
not be directly applied. As an alternative, we shift the 
conduction band by adding orbital dependent potentials 
into the Hamiltonian, allowed in a full-potentials code 
such as Wien2k (this procedure underlies the well-known 
LDA+U method). This allows us to test the robust- 
ness of the band topology against band gap corrections. 
Applying the orbital potentials on one specific atom can 
also be considered as changing the local potential on site. 
This allows us to test the robustness of band topology 
against alloying. For thallium-based HTV-VI2 ternary 
chalcogenides, the orbital character of the valence band is 
p-type of X atoms, while the conduction band is primar- 



ily p-type of M' atoms. We then add orbital dependent 
potentials Va to all three p-orbitals of M' to mimic the 
band gap correction or alloying on this site which moves 
the conduction band upwards. For an example, we study 
TlBiTe2, Fig. 2(A). DFT-GGA predicts TlBiTe2 to be 
a topologically trivial metal due to an even number of 
band inversion. As Va increases, the whole conduction 
band move upwards, but the direct gaps at both F and 
X-points become smaller. As shown in Fig. 2C, the gap 
at X first vanishes at Va=O.Se'V at which the conduc- 
tion band and valence band join and form a 3D Dirac- 
cone. The transition for the F point occur at larger value 
1.9eV of Va. In between these two critical points, bands 
are inverted only at the F-point relative to PbTe and 
the system becomes topologically non-trivial (gray area 
in Fig.2C), with Z2 topological index (1;000). Similar 
band inversions at X-points after band correction have 
been found in other compounds of this family as well. De- 
spite uncertainties inherent in first-principles electronic 
structure calculations, we have identified the band inver- 
sion at X-points (relative to PbTe) as the decisive factor 
of their topological class, which by itself suggests several 
ways to engineer the band structure towards the topo- 
logical insulator side, including rhombohedral distortion 
and alloying. 

A non-trivial band topology will generate metallic sur- 
face states which are the hallmark of topological insu- 
lators. For the 111 surface in thallium-based III-V-VI2 
ternary chalcogenides, the atoms are sequenced as -M-X- 
M'-X- and there are four possible surface terminations 
(see Fig. lA). Unlike in topological insulators Bi2Se3 and 
Bi2Te3, the bonding between the layers in T1M'X2 is 
not weak and there are no natural cleavage planes. As 
a result, the topologically protected surface states may 
coexist with non-topological ones arising from dangling 
bonds, leading to a complicated surface spectrum. We 
have carried out extensive slab calculations on all possi- 
ble surface terminations for all six compounds to search 
for a simple surface spectrum. We have found that the 
termination between X and M atoms can give a such 
case. On the X exposed surface, there are much less 
trivial surface states compared with other surface termi- 
nations. In Fig. 2(D), we show the surface band structure 
of TlBiTe2, assuming Va = 1.5 eV to be in the topologi- 
cal non-trivial phase. The surface states are shown as red 
lines. The calculation is based on a slab with 47 atomic 
layers. Between F and M points, there is only one sur- 
face band connecting conduction band and valence band. 
This is the unambiguous evidence of non-trivial topolog- 
ical nature. 

Even though all six compounds are found to be 
topologically trivial by DFT-GGA calculations without 
bandgap correction, their surface states may have Dirac- 
cone dispersions due to the band inversion. In Fig. 3, 
we show the results without bandgap corrections for 23 
atomic layer slab where the X atoms are exposed at both 
sides of the slab. The thickness is about 50 Angstroms. A 
Dirac cone with a small gap at f is obtained in TlSbTe2 
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FIG. 3: Band structures based on thin slab calculations for 
TlSbTes (A), TlSbSes (B), TlSbSs (C), TlBiTes (D), TlBiSes 
(E), TlBiS2 (F), AgBiTe2 (G), AgBiSes (H), and AglnSes (I) 
without bandgap corrections. The blue area indicates the 
projected bulk bands. The red lines are surface states. 

(A), TlSbSes (B), TlBiTes (D), and TlBiSes (E). The 
gap is found to decrease rapidly as the slab thickness in- 
creases, indicating that a gapless Dirac band exists at T 
on the surface of the infinite thickness limit. Therefore 
the existence of a surface Dirac band at T by itself can- 
not reveal the band topology. This indicates that a k • 
p model Hamiltonian around F is not adequate for these 
compounds. Since band topology is determined by the 
band structure near X-points, it is the surface spectrum 
near M-points that distinguishes trivial and non-trivial 
phases. In our slab calculations, surface states near M 
have strong finite size effects arising from interactions be- 
tween the two sides of the slab. This is a consequence of 
the smaller band gap near M found in our bulk calcu- 



lations. We note that AgBiTe2, AgBiSe2, and AgInSe2 
all have a similar crystal structure to the present com- 
pounds, but with M = Ag. However, there is no band 
inversion from our calculation. The surface states of the 
thin- film are just pull out from the bulk bands. They 
have similar band dispersion as bulk bands. There is no 
protected Dirac cone hke surface band. 

Apart from the fact that Tl-compounds are usually 
semi-metallic or very weakly semiconducting, they are 
topologically very similar to the Bi2Se3 series discov- 
ered previously. Recently, it was discovered that upon 
Cu doping, Bi2Se3 becomes a superconductor with a Tc 
= 3.8K and exhibit unconventional band topology p5l - 
[27I]. The doped topological states in the Tl-based com- 
pounds are also likely to become superconductors. The 
Tl-series thus provides a fertile ground to search for odd- 
parity topological superconductors candidates similar to 
the Cu^Bi2Se3 series |25Hi27|. 

In conclusion, we have shown that thallium-based III- 
V-VI2 ternary chalcogenides harbor a band-structure ma- 
trix for Z2 =-1 topological states and unlike the Bi2Se3 
series the topological state in the Tl-chalcogenides criti- 
cally depend on the nature of the band ordering near the 
X point of the Brillouin zone and the topological nature 
is shown to be characterized by band inversions at both 
F and X-points. We identified the material surface ter- 
mination that hosts the single Dirac cone surface states. 
The overall results suggest that these materials can be a 
new platform to search for topological superconductors 
along the lines realized in Cua;Bi2Se3 [25l-[27j. After the 
completion of this work, we became aware of a preprint 
by Yan et al. [28] on the present Tl-compounds. In con- 
trast, however, we have identified through first principles 
computations the specific surface termination plane that 
features the protected single Dirac cone suitable for pho- 
toemission (ARPES) studies of this class of materials. 
Moreover, we have clarified the relationship of the Tl- 
compounds with PbTe, obtaining insight into pathways 
for engineering topologically interesting properties. 
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